Method and apparatus for providing user interface of portable device

ABSTRACT

A method includes displaying a user interface for displaying a graphic and a hidden graphic in a first area; displaying a set of contents corresponding to the graphic in a second area distinguishable from the first area; detecting a user&#39;s gesture for selecting a part of the first area; enlarging the first area to include a part of the second area; displaying a plurality of graphics including the graphic and the hidden graphic in the extended first area in response to the user&#39;s gesture; detecting a user&#39;s additional gesture for moving a first graphic among the plurality of graphics; and moving the first graphic to a part of the extended first area in response to the user&#39;s additional gesture, and moving a second graphic of the plurality of graphics to an area from which the first graphic is moved out.

CROSS-REFERENCE TO RELATED APPLICATIONS

This is a Continuation of U.S. application Ser. No. 12/958,770 filedDec. 2, 2010, which claims priority from U.S. Provisional ApplicationsNo. 61/265,923 and No. 61/265,939, filed Dec. 2, 2009, and Korean PatentApplication No. 10-2010-0119922, filed on Nov. 29, 2010 in the KoreanIntellectual Property Office, the disclosures of which are incorporatedherein by reference in their entireties.

BACKGROUND

1. Field

Apparatuses and methods consistent with exemplary embodiments relate toa method and an apparatus for providing a user interface, and moreparticularly, to a method and an apparatus for providing a moreefficient user interface by using a screen configuration.

2. Description of the Related Art

A user interface (UI) may provide a temporary or continuous access toenable a communication between a user and an object, a system, a deviceor a program. The UI may include a physical or virtual medium.Generally, the UI may be divided into an input by which a usermanipulates a system and an output by which a response or result of theinput to the system is displayed.

Input needs an input device to move a cursor on a screen or to receive auser's manipulation to select a particular object. For example, theinput device may include a button, a key, a mouse, a track ball, a touchpad, a joy stick or a touch screen. Output needs an output device toidentify a response to the input by using user's sense of sight, hearingor touch. For example, the output device may include a displayapparatus, a touch screen, a speaker or an oscillator.

The touch screen may provide both input and output through a screen.Users may touch the screen by using their fingers or a stylus. Acomputer may recognize the touch on the touch screen, analyze the touchand perform a corresponding operation based on the touch.

SUMMARY

Exemplary embodiments address at least the above problems and/ordisadvantages and other disadvantages not described above. Also, anexemplary embodiment is not required to overcome the disadvantagesdescribed above, and an exemplary embodiment may not overcome any of theproblems described above.

According to an aspect of an exemplary embodiment, there is provided amethod for providing a user interface of a portable device, the methodincluding: displaying a user interface for displaying at least onegraphic and a hidden graphic in a first area; displaying a set ofcontents corresponding to one of the at least one graphic in a secondarea distinguishable from the first area; detecting a user's gesture forselecting a part of the first area; enlarging the first area up to apart of the second area and displaying a plurality of graphics includingthe at least one graphic and the hidden graphic in the extended firstarea in response to the user's gesture; detecting a user's additionalgesture for moving at least one among the plurality of graphics; andmoving at least one among the plurality of graphics to a part of theextended first area in response to the user's additional gesture, andmoving at least one of the graphics other than the at least one graphicto an area from which the at least one graphic is moved out.

The displaying the plurality of graphics including the at least onegraphic and the hidden graphic in the extended first area may include:displaying at least a part of the hidden graphic in an area convertedfrom the second area to the first area.

The displaying a user interface for displaying at least one graphic anda hidden graphic in the first area may include detecting the user'sgesture for selecting the user interface; and displaying the hiddengraphic in response to the user's gesture.

The hidden graphic may be positioned in a front direction or a backdirection of the at least one graphic, and the detecting the user'sgesture for selecting the user interface may include: detecting acontact position and a contact released position of the user on the userinterface; determining a direction of the gesture on the basis of thecontact position and the contact released position; and displaying thehidden graphic corresponding to the direction of the gesture among thegraphics positioned in the front or back direction.

The hidden graphic may be positioned in a front direction or a backdirection of the at least one graphic, and the displaying the userinterface for displaying the at least one graphic and the hidden graphicin the first area may include: displaying an identifier, which shows adirection where the hidden graphic is positioned, at one side of thefirst area corresponding to the first or back direction.

The displaying the user interface for displaying the at least onegraphic and the hidden graphic in the first area may include: giving avisible feedback to one of the at least one graphic, and the displayinga set of contents corresponding to one of the at least one graphic inthe second area includes: displaying the set of contents correspondingto the graphic, to which the visible feedback is given, in the secondarea.

The displaying a plurality of graphics including the at least onegraphic and the hidden graphic in the extended first area may include:removing the visible feedback given to one graphic of the at least onegraphic.

The displaying a plurality of graphics including the at least onegraphic and the hidden graphic in the extended first area may include:inactivating the set of the at least one content displayed in the secondarea.

The plurality of graphics may be divided into a first group of graphicsand a second group of graphic in accordance with respective positions ofthe plurality of graphics in the first area, and the displaying aplurality of graphics including the at least one graphic and the hiddengraphic in the extended first area may include: detecting a user'sgesture for selecting a part of the second area; and downsizing theextended first area into an original area in response to the user'sgesture, and displaying the first group of graphics in the downsizedfirst area.

The moving at least one among the plurality of graphics within theextended first area, and moving at least one of the graphics other thanthe at least one graphic to an area from which the at least one graphicis moved out may include: moving a first graphic among the plurality ofgraphics to an area for a second graphic among the plurality ofgraphics; and moving the second graphic to an area from which the firstgraphic is moved out, if the first graphic is not moved any more for apredetermined period of time.

The graphic may include a tab menu.

According to another aspect of an exemplary embodiment, there isprovided a portable device providing a user interface, the portabledevice including: a touch screen which includes a first area to displaya user interface for displaying at least one graphic and a hiddengraphic, and a second area to display a set of contents corresponding toone of the at least one graphic, which is distinguishable from the firstarea; a processor; and a memory, the processor detecting a user'sgesture for selecting a part of the first area; enlarging the first areaup to a part of the second area and displaying a plurality of graphicsincluding the at least one graphic and the hidden graphic in theextended first area in response to the user's gesture; detecting auser's additional gesture for moving at least one among the plurality ofgraphics; and moving at least one among the plurality of graphics to apart of the extended first area in response to the user's additionalgesture, and moving at least one of the graphics other than the at leastone graphic to an area from which the at least one graphic is moved out.

In the case of displaying the plurality of graphics including the atleast one graphic and the hidden graphic in the extended first area, theprocessor may display at least a part of the hidden graphic in an areaconverted from the second area to the first area.

The processor may detect the user's gesture for selecting the userinterface; and display the hidden graphic in the first area in responseto the user's gesture.

In the case of displaying a plurality of graphics including the at leastone graphic and the hidden graphic in the extended first area, theprocessor may remove a visible feedback given to one graphic of the atleast one graphic.

In the case of displaying a plurality of graphics including the at leastone graphic and the hidden graphic in the extended first area, theprocessor may inactivate the set of the at least one content displayedin the second area.

The plurality of graphics may be divided into a first group of graphicsand a second group of graphic in accordance with respective positions ofthe plurality of graphics in the first area, and in the case ofdisplaying a plurality of graphics including the at least one graphicand the hidden graphic in the extended first area, the processor maydetect a user's gesture for selecting a part of the second area; anddownsize the extended first area into an original area in response tothe user's gesture, and displays the first group of graphics in thedownsized first area.

In the case of moving at least one among the plurality of graphicswithin the extended first area, and moving at least one of the graphicsother than the at least one graphic to an area from which the at leastone graphic is moved out, the processor may move a first graphic amongthe plurality of graphics to an area for a second graphic among theplurality of graphics; and move the second graphic to an area from whichthe first graphic is moved out, if the first graphic is not moved anymore for a predetermined period of time.

The graphic may include a tab menu.

According to another aspect of an exemplary embodiment, there isprovided a computer-readable medium in which a program is recorded toexecute a method for providing a user interface in a portable device,the method including: displaying a user interface for displaying atleast one graphic and a hidden graphic in a first area; displaying a setof contents corresponding to one of the at least one graphic in a secondarea distinguishable from the first area; detecting a user's gesture forselecting a part of the first area; enlarging the first area up to apart of the second area and displaying a plurality of graphics includingthe at least one graphic and the hidden graphic in the extended firstarea in response to the user's gesture; detecting a user's additionalgesture for moving at least one among the plurality of graphics; andmoving at least one among the plurality of graphics to a part of theextended first area in response to the user's additional gesture, andmoving at least one of the graphics other than the at least one graphicto an area from which the at least one graphic is moved out.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects will become more apparent from thefollowing description of exemplary embodiments, taken in conjunctionwith the accompanying drawings, in which:

FIG. 1 is a block diagram of a device which includes a touch screenaccording to an exemplary embodiment;

FIG. 2 is a block diagram of a connection between a sensor controllerand various types of sensors according to an exemplary embodiment;

FIG. 3 illustrates an example of a memory of the device according to anexemplary embodiment;

FIG. 4 illustrates an example of a screen configuration of the devicewhich includes the touch screen according to an exemplary embodiment;

FIG. 5 illustrates a user interface of an apparatus according to anexemplary embodiment;

FIGS. 6A, 6B, and 6C illustrate an example of an operation of a userinterface according to an exemplary embodiment;

FIGS. 7A, 7B, 7C, and 7D illustrate a process of providing a hiddengraphic according to an exemplary embodiment;

FIGS. 8A and 8B illustrate a process of providing at least one ofgraphics and a hidden graphic according to an exemplary embodiment;

FIGS. 9A and 9B illustrate a process of moving at least one of theplurality of graphics according to an exemplary embodiment;

FIGS. 10A and 10B illustrate a process of moving at least one of theplurality of graphics according to another exemplary embodiment;

FIGS. 11A and 11B illustrate a process of providing a first group ofgraphics among the plurality of graphics according to an exemplaryembodiment; and

FIG. 12 is a flowchart showing a method of providing a user interface ofthe apparatus according to an exemplary embodiment.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Certain exemplary embodiments are described in greater detail below withreference to accompanying drawings.

In the following description, like drawing reference numerals are usedfor like elements, even in different drawings. The matters defined inthe description, such as detailed construction and elements, areprovided to assist in a comprehensive understanding of exemplaryembodiments. However, exemplary embodiments can be practiced withoutthose specifically defined matters.

A computer system is used as a reference to explain exemplaryembodiments. The skilled in the art may fully understand that the systemand methods as described below are applicable to a voluntary displaysystem including a user interface.

“Exemplary embodiment”, “example”, “aspect” and “exemplification” usedherein shall not be construed that the discretionary aspect or designexplained herein are better or more advantageous than other aspects ordesigns.

“Component”, “module”, “system” and “interface” used hereinbelow means acomputer-related entity in general, and e.g., may mean hardware, acombination of hardware and software, or software.

“Or” means an ‘inclusive or” rather than “exclusive or”. That is, unlessotherwise stated or explicit in the context, the expression “x uses a orb” means one of natural inclusive permutations.

The singular used herein should be interpreted as including “one ormore” unless otherwise stated or explicit in the context regarding thesingular type.

“And/or” used herein should be understood as referring to and includingall of available combinations of at least one item of listed, relevantitems.

“Include” and/or “including” means that the concerned property, step,operation, module, elements and/or components exist, but does notexclude that one or more of other properties, steps, operations,modules, elements and component and/or a group thereof exist or areadded.

“First”, “Second”, etc. may be used herein to explain various elements,but the elements are not limited to such terms. The terms are used onlyto distinguish two or more elements and there is no order or order ofpriority between the elements.

Hereinafter, an apparatus according to an exemplary embodiment will bedescribed. In an exemplary embodiment, the apparatus, a user interface(UI) for the apparatus and a relevant process for using the apparatuswill be described. Such apparatus may include a device which furtherincludes a PDA function, a music playing or calling function and otherfunctions. However, all or part of the apparatus, the user interface andthe relevant process according to an exemplary embodiment which will bedescribed below are applicable to digital devices such as a personalcomputer, a laptop computer, a digital TV, etc.

The apparatus may support at least one of a telephone application, avideo conference application, an e-mail application, an instantmessaging application, a blogging application, a photo managingapplication, a digital camera application, a digital video cameraapplication, a web browsing application, a digital music playingapplication and a digital video playing application.

The various applications above may use, e.g., a physical or virtual UI.For example, a user may change or move information displayed on a touchscreen within a single application or to another application through thephysical or virtual UI. The apparatus may support various applicationsby using a physical or virtual UI that is intuitive and clear and uses acommon physical or virtual architecture.

FIG. 1 is a block diagram of an apparatus 100 which includes a touchscreen 121 according to an exemplary embodiment.

The apparatus 100 may include at least one processor 101, a memory 102,a peripheral interface 103, an input/output (I/O) subsystem 110, a touchscreen 121, a sensor 122, another I/O device 123, a radio frequency (RF)circuit 131, an audio circuit 132, a power circuit 133 and an externalport 134. Such components may communicate with each other through atleast one communication bus or signal line.

FIG. 1 illustrates an example of the apparatus 100, and the apparatus100 may include more or fewer components, or have a configuration orarrangement integrating two or more components or including differentcomponents. The components shown in FIG. 1 may include hardwareincluding an integrated circuit customized for at least one signalprocessing or application, software or a combination of hardware andsoftware.

The memory 102 may include, e.g., a high-speed random access memory, amagnetic disk, an SRAM, a DRAM, a ROM, a flash memory or a non-volatilememory. The memory 102 may include a software module, an instruction setor other various data. An access to the memory 102 by other componentssuch as the processor 101 and the peripheral interface 103 may becontrolled by the processor 101.

The peripheral interface 103 may integrate the input and/or outputperipheral device of the apparatus 100 to at least one processor 120 andmemory 102. The processor 101 may perform various functions and processdata by executing the software module or the instruction set stored inthe memory 102.

The RF circuit 131 may transmit and receive an RF signal which is alsoknown as an electromagnetic signal. The RF circuit 131 may convert anelectric signal into an electromagnetic signal, convert anelectromagnetic signal into an electric signal and communicate with acommunication network or other communication devices through anelectromagnetic signal. The RF circuit 131 may include a known circuitto perform the foregoing function. The known circuit may include anantenna system, an RF transmitter/receiver, at least one amplifier, atuner, at least one oscillator, a digital signal processor, a codecchipset, a subscriber identification module (SIM) card, and a memory,but not limited thereto. The RF circuit 131 may communicate in awireless communication with a cellular phone network, a wireless networksuch as wireless local area network (LAN) and/or metropolitan areanetwork (MAN), a network such as an intranet and/or the Internet alsocalled the World Wide Web (WWW) and other devices. Such wirelesscommunication may include an e-mail protocol such as Global System forMobile Communications (GSM), Enhanced Data GSM Environment (EDGE),Wideband Code Division Multiple Access (W-CDMA), Code Division MultipleAccess (CDMA), Time Division Multiple Access (TDMA), Bluetooth, WirelessFidelity (Wi-Fi) for IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/orIEEE 802.11n, Voice over Internet Protocol (VoIP), Wi-MAX, Long TermEvolution (LTE), Internet Message Access Protocol (IMAP) and/or PostOffice Protocol (POP); an instant messaging protocol such as eXtensibleMessaging and Presence Protocol (XMPP), Session Initiation Protocol forInstant Messaging and Presence Leveraging Extensions (SIMPLE), InstantMessaging and Presence Service (IMPS) or Short Message Service (SMS) orcommunication protocols which are not developed at the time of theapplication date of the present application. In addition to theforegoing wireless communication, other communication standards,protocols and technology may be used.

The audio circuit 132 may provide an audio interface between a user andthe apparatus 100 by using a speaker and/or a microphone. The audiocircuit 132 may receive audio data from the peripheral interface 103,convert audio data into electric signals and transmit electric signalsto the speaker. The speaker may convert the electric signal into ahuman-audible sound wave. The audio circuit 132 may receive an electricsignal converted from a sound wave by a microphone. The audio circuit132 may convert an electric signal into audio data, and transmit theaudio data to the peripheral interface 103 to process the audio data.The audio data may be searched from or transmitted to the memory 102 orthe RF circuit 131 by the peripheral interface 103. According to anaspect, the audio circuit 132 may further include a headset jack. Theheadset jack may provide an interface between a headset including inputand output devices or a portable audio I/O peripheral device such as anoutput headphone.

The power circuit 133 may supply power to all or part of the componentsof the apparatus 100. For example, the power circuit 133 may include apower management system, at least one power source such as a battery oralternating current (AC) power source, a charging system, a powerfailure detection circuit, a power transformer or inverter, a powerindicator and other voluntary components for generating, managing anddistributing power.

The I/O subsystem 110 may integrate an I/O peripheral device such as thetouch screen 121, the sensor 122 or the another input control device 123to the peripheral interface 103. The I/O subsystem 110 may include adisplay controller 111, a sensor controller 112 or at least one I/Ocontroller 113. According to another aspect, the touch screen 121, thesensor 122 or the input control device 123 may be integrated directly tothe peripheral interface 103, instead of through the I/O subsystem 100.

According to another aspect, at least one of the processor 101, theperipheral interface 103 and the I/O subsystem 110 may be provided in asingle chip. Otherwise, a part of at least one of the processor 101, theperipheral interface 103 and the I/O subsystem 110 may be provided in asingle chip.

The display controller 111 may receive an electric signal from the touchscreen 121 including a touch-detection area, transmit an electric signalto the touch screen 121 or transmit and receive an electric signalto/from the touch screen 121. By a control of the display controller111, the touch screen 121 may display thereon a visual output for auser. The visual output may include a graphic, a text, an icon, a videoand a combination of the foregoing elements (collectively, the“graphic”). According to an aspect, a part or all of the visual outputmay correspond to a user interface which will be described later in moredetail.

The touch screen 121 may include a liquid crystal display (LCD), a lightemitting polymer display (LPD), an organic light emitting diode (OLED),an active-matrix organic light-emitting diode (AMOLED) or otherdisplays. The touch screen 121 and the display controller 111 may employcapacitive technology, resistive technology, infrared technology andsurface acoustic wave technology, but not limited thereto, and mayfurther include other known technologies or touch detection technologywhich will be developed in the future. The touch screen 121 and thedisplay controller 111 may detect a contact point, its movement orrelease by using a proximity sensor array or other elements to determineat least one contact address with the touch screen 121.

The display controller 111 may be coupled with a screen which does notinclude a touch-detection area. The touch-detection area excludingscreen may receive an electric signal from the display controller 111and display a visual output for a user. The touch-detection areaexcluding screen may include a plasma display panel (PDP), an electronicpaper display (EPD), a liquid crystal display (LCD), a light emittingpolymer display (LPD), an organic light-emitting diode (OLED), anactive-matrix organic light-emitting diode (AMOLED) and other displays.The apparatus 100 which employs the screen excluding the touch-detectionarea may provide an I/O device such as a keyboard, a mouse or a physicalbutton as a user interface.

The at least one another I/O controller 113 may receive an electricsignal from the another I/O device 123 or transmit an electric signal tothe another I/O device 123. The another I/O control device 123 mayinclude, e.g., a button, a keyboard, a touch pad, a dial, a sliderswitch or a joy stick. The another I/O controller 113 may be integratedto any of an infrared port, a USB port and a mouse.

According to an aspect, the another I/O control device 123 may includeat least one physical or virtual button. In the case of the virtualbutton, the button and a button controller may be a part of the touchscreen 121 and the display controller 111, respectively. According to anaspect, the button may include an up/down button, a locker button or apush button to adjust a volume of the speaker 111 or the microphone 113.For example, if a user presses the push button briefly, the touch screen121 is unlocked and an unlocking process may be initiated by applying agesture to the touch screen. Otherwise, a user may press the push buttonlong to turn on or turn off power to the apparatus 100.

According to another aspect, the another I/O control device 123 mayinclude at least one physical keyboard or virtual soft keyboard. As anexample of the keyboard, Qwerty and/or non-Qwerty may be used. In thevirtual soft keyboard, the soft keyboard and the soft keyboardcontroller may be a part of the touch screen 121 and the displaycontroller 111, respectively. The soft keyboard according to anexemplary embodiment may include a fewer number of graphics (or softkeys) than the physical keyboard. Then, a user may select at least onegraphic of the soft keyboard, and display at least one correspondingsymbol on the touch screen 121.

According to another aspect, the another I/O control device 123 mayinclude a touch pad to enable or disable a particular function.According to another aspect, the touch pad may include a touch-detectionarea which does not display thereon the visual output unlike the touchscreen. The touch pad may include a touch-detection surface separatedfrom the touch screen 121, or a part of the touch-detection surfaceformed and extended from the touch screen 121.

FIG. 2 is a block diagram of a connection between the sensor controller112 and various types of sensors 122 according to an exemplaryembodiment.

The sensor controller 112 may receive an electric signal from the sensor122, transmit an electric signal to the sensor 122 or transmit andreceive an electric signal to/from the sensor 122. The sensor 122 mayinclude an optical sensor 122, a proximity sensor 122 b, anaccelerometer 122 c, a GPS sensor 122 d, a magnetic sensor 122 e, a tiltsensor 122 f, an ambient sensor 122 g and a weather sensor 122 h, butnot limited thereto.

According to an aspect, the sensor 122 may include at least one opticalsensor 122 a. FIG. 2 illustrates the optical sensor 122 a which isintegrated to the sensor controller 112 of the I/O subsystem 110. Theoptical sensor 122 a may be integrated to the peripheral interface 103.The optical sensor 122 a may include a charge coupled device (CCD) orcomplementary metal oxide semiconductor (CMOS) photo transistor. Theoptical sensor 122 a may receive light emitted through at least one lensfrom the environment and convert such light into image data. Togetherwith an image module 143, a so-called camera module, the optical sensor122 a may capture a still image or video. According to another aspect,to use the touch screen display as a view finder to acquire at least oneof a still image and a video, the optical sensor 122 a may be providedin a rear side or a front side of the apparatus 100. According to anaspect, to acquire an image of a user for a video conference while auser views other video conference attendees on the touch screen display,the optical sensor 122 a may be provided in the front side of theapparatus 100. According to another aspect, a user may rotate a lens anda sensor of the apparatus housing to change a location of the opticalsensor 122 a so that the single optical sensor 122 a acquires a stillimage or a video for the video conference. Further, the apparatus 100may detect the light amount from the optical sensor 122 a, adjust abrightness of a particular area of the touch screen 121 by using a valuecorresponding to the light amount, or adjust a brightness of a graphicon the touch screen 121.

According to an aspect, the sensor 122 may include at least oneproximity sensor 122 b. FIG. 2 illustrates the proximity sensor 122 bwhich is connected to the sensor controller 112 of the I/O subsystem110. Otherwise, the proximity sensor 122 b may be connected to theperipheral interface 103. The proximity sensor 122 b may detect whetherany object is proximate to the apparatus 100. For example, the proximitysensor 122 b may provide an on or off value with respect to adetection/non-detection of the object. According to an aspect, when theapparatus 100 is proximate to a user's ear like talking over the phone,the proximity sensor 122 b may turn off the touch screen 121 to therebyprevent unnecessary battery consumption.

According to another aspect, the sensor 122 may further include at leastone of accelerometers 122 c. FIG. 2 illustrates the accelerometer 122 cwhich is connected to the sensor controller 112 of the I/O subsystem110. Otherwise, the accelerometer 122 c may be connected to theperipheral interface 103. The accelerometer 122 c may detect a change ofspeed of the apparatus 100 or a direction of the apparatus 100. Forexample, the accelerometer 122 c may measure an accelerating vectorvalue of the apparatus 100 in three axes of X, Y and Z. Theaccelerometer 122 c may provide a displacement value per hourcorresponding to the three axes. According to an aspect, information maybe displayed on the touch screen 121 vertically or transversely on thebasis of the analysis of data transmitted from the at least oneaccelerometer 122 c.

According to another aspect, the sensor 122 may further include at leastone GPS sensor 122 d. FIG. illustrates the GPS sensor 122 d which isconnected to the sensor controller 112 of the I/O subsystem 110.Otherwise, the GPS sensor 122 d may be connected to the peripheralinterface 103. The GPS sensor 122 d may receive at least one satellitesignal, process the received signal and detect a location of theapparatus 100 on earth. For example, the GPS sensor 122 d may providelatitude, longitude and altitude values of the apparatus 100 based onthe detected value. For example, the GPS sensor 122 d may provide thelatitude value of −90 up to +90 degrees and the longitude value of −180up to +180 degrees. According to an aspect, the location of theapparatus 100 on earth may be displayed on the touch screen 121 on thebasis of the analysis of data transmitted from the GPS sensor 122 d.

According to another aspect, the sensor 122 may further include at leastone magnetic sensor 122 e. FIG. 2 illustrates the magnetic sensor 122 ewhich is connected to the sensor controller 112 of the I/O subsystem110. Otherwise, the magnetic sensor 122 e may be connected to theperipheral interface 103. For example, the magnetic sensor 122 e maydetect an intensity or a change of a magnetic field generated on earth,process the detected signal and determine a direction value of theapparatus 100. For example, the magnetic sensor 122 e may provide theintensity and change of the magnetic field as values of three axes of X,Y and Z based on the detected value. According to an aspect, theapparatus 100 may change a rotation of a predetermined icon on the touchscreen 121 by using the value provided by the magnetic sensor 122 e.

According to another aspect, the sensor 122 may further include at leastone tilt sensor 122 f. FIG. 2 illustrates the tilt sensor 122 f which isconnected to the sensor controller 112 of the I/O subsystem 110.Otherwise, the tilt sensor 122 f may be connected to the peripheralinterface 103. The tilt sensor 122 f may include at least oneaccelerometer and at least one magnetic sensor. The tilt sensor 122 fmay provide, e.g., azimuth, pitch and roll values by using the values ofthree axes of X, Y and Z detected from the sensors. For example, thetilt sensor 122 f may provide the value ranging from zero to 360 degreesas an azimuth value, the value ranging from −180 to +180 degrees as apitch value, and the value ranging from −90 to +90 degrees as a rollvalue. The apparatus 100 according to an aspect may detect a user'sgesture gripping and moving the apparatus 100 by using the tilt sensor122 f.

According to another aspect, the sensor 122 may further include at leastone ambient sensor 122 g. FIG. 2 illustrates the ambient sensor 122 gwhich is connected to the sensor controller 112 of the I/O subsystem110. Otherwise, the ambient sensor 122 g may be connected to theperipheral interface 103. The ambient sensor 122 g may detecttemperature, humidity and intensity of illumination of the ambientenvironment of the apparatus 100. The ambient sensor 122 g may acquirethe detected value per hour. For example, the ambient sensor 122 g mayprovide humidity values ranging from zero to 100%, and temperature inFahrenheit or Celsius, and the intensity of illumination from level zeroto 10. According to an aspect, the apparatus 100 may display on thetouch screen 121 the value of the ambient environment of the apparatus100 acquired through the ambient sensor 122 g.

According to another aspect, the sensor 122 may further include at leastone weather sensor 122 h. FIG. 2 illustrates the weather sensor 122 hwhich is connected to the sensor controller 112 of the I/O subsystem110. Otherwise, the weather sensor 122 h may be connected to theperipheral interface 103. The weather sensor 122 h may provideinformation on humidity, temperature or weather. The weather informationrelating to a particular day or time may be acquired from an externalserver. The server may provide weather information based on informationof a user's location. According to an aspect, the apparatus 100 maytransmit to the server an http request signal including locationinformation. The server may search the weather information on thelocation based on the location information of the apparatus 100, andprovide the apparatus 100 with the searched information as an eXtensibleMarkup Language (XML) document. For example, the weather sensor 122 hmay provide the value of humidity ranging from zero to 100%, and thetemperature in Fahrenheit or Celsius, and the condition relating toweather as an integer.

Returning back to FIG. 1, the apparatus 100 may perform an operationcombining a predetermined function through a screen including atouch-detection area such as the touch screen 121 (or touch pad). Inthis case, a basic input/control is available on the touch screen 100for the operation of the apparatus 100, and the number of a physicalinput/output device such as a push button, keyboard and dial of theapparatus 100 may be reduced.

To perform the operation combining the predetermined function throughthe touch screen 121, a UI may be displayed on the touch screen 121 fornavigation. According to an aspect, if a user touches the touch screen121, the touch screen 121 may provide a UI such as a main menu or rootmenu. According to another aspect, the apparatus 100 may provide aphysical push button or other physical input and control devices as aUI.

According to an aspect, the apparatus 100 may perform the operationcombining the predetermined function through a screen excluding thetouch-detection area. The apparatus 100 may use a UI such as a physicalkeyboard, a mouse and a physical button as a basic input/control device.According to an aspect, if a user manipulates a physical UI, theapparatus 100 may display a visual output on the screen excluding thetouch-detection area corresponding to a user's manipulation.

According to another aspect, the apparatus 100 may perform the operationcombining the predetermined function through both the touch screen 121(or touch pad) including the touch-detection area, and the screenexcluding the touch-detection area. The apparatus 100 may use at leastone of a physical UI and a virtual UI as a basic input/control device.According to an aspect, if a user touches the physical UI or manipulatesthe virtual UI, the apparatus 100 may interact with the physical orvirtual UI and display the result of a user's touch or manipulation onat least one of the touch screen 121 including the touch-detection areaand the screen excluding the touch-detection area.

The touch screen 121 may provide a UI between the apparatus 100 and auser. For example, the touch screen 121 may include a touch-detectionsurface, a sensor or a sensor set which detects a user's input based ona haptic contact or a tactile contact. The touch screen 121 and thedisplay controller 111 may detect a contact, a movement of such contactor a release of contact on the touch screen 121, and convert suchdetected contact into an interaction with the UI (graphic, at least onesoft key, icon, web page or image) displayed on the touch screen 121.According to an aspect, a contact address between the touch screen 121and a user may correspond to a user's finger, a voluntary object such asa stylus or an appendage. According to an aspect, the UI is designed tooperate by a contact mainly based on a user's finger and gesture, whichis less accurate than the input by the stylus since the former has alarger contact area on the touch screen 121. In this case, the apparatus100 may analyze a finger-based rough input as a location or command ofan accurate pointer or cursor to perform a desired operation.

The touch screen 121 may display at least one graphic as a UI. Accordingto an aspect, a user may contact (touch) and select at least one graphicby using at least one of his/her fingers. According to another aspect,if a user releases the contact of the at least one graphic, the at leastone graphic may be selected. According to an aspect, a user's gesturemay include a touch to select a graphic or an area relating to thegraphic, a tap which is a gesture touching and releasing the touch toexecute a graphic application or receive another graphic, a double tapincreasing or decreasing the graphic, a hold maintaining a touch forpredetermined time to receive a detailed menu relating to the graphic, atouch and move touching and moving (left to right, right to left or upand down and down and up) or releasing such touch to scroll an itemlist, a flick or swipe touching, moving and releasing such touch withinshort time to move to a superior or subordinate list relating to thegraphic or to execute other useful functions, and a drag and drop tomove the graphic to a desired location. According to an aspect, anaccidental contact of the graphic may not select the graphic. Forexample, if the gesture corresponding to the selection is a tap, apredetermined application may not be selected by a swipe going over thegraphic relating to such application. According to another aspect, theapparatus 100 may employ a heuristic method to determine a user'sgesture accurately. According to an aspect, cumulative data of a user'sgesture, user's characteristics and pattern may be detected and analyzedby the heuristic method, and the apparatus 100 may determine the intentof such user's gesture by using the analyzed data, characteristic andpattern.

According to an aspect, the touch screen 121 may display a virtual softkeyboard as a UI. A user may select at least one graphic (or soft key)of the soft keyboard and display at least one symbol on the touch screen121. The soft keyboard according to an exemplary embodiment may beadaptive. For example, the displayed graphic may be adjusted by a user'saction selecting at least one graphic or at least one symbol. At leastone application of the apparatus 100 may employ a common keyboard ordifferent keyboards. Accordingly, the used soft keyboard may becustomized for at least a part of the applications or for each user. Forexample, the at least one soft keyboard according to an exemplaryembodiment may be customized for each user on the basis of a word usagerecord of such user. The soft keyboard may be adjusted to reduce auser's mistake when he/she selects at least one graphic and at least onecorresponding symbol.

Hereinafter, an example of a configuration of the memory 102 which isincluded in the apparatus 100 will be described in more detail withreference to FIG. 3.

FIG. 3 illustrates an example of the configuration of the memory 102 ofthe apparatus 100 according to an exemplary embodiment.

According to an aspect, a software component which is stored in thememory 102 may include an operating system (OS) 210, a communicationmodule (or an instruction set) 261, a social networking module (or aninstruction set) 263, a commerce service module (or an instruction set)265, a location based service (LBS) module (or an instruction set) 267,an interaction module (or an instruction set) 269, a sensor module (oran instruction set) 271, a graphic module (or an instruction set) 273, atext input module (or an instruction set) 275 and an application (or aninstruction set) 220.

According to an aspect, the communication module 261, the socialnetworking module 263, the commerce service module 265, the LBS module267, the interaction module 269, the sensor module 271, the graphicmodule 273 or the text input module 275 may be included in the OS 210.For example, the communication module 261, the social networking module263, the commerce service module 265, the LBS module 267, theinteraction module 269, the sensor module 271, the graphic module 273 orthe text input module 275 may provide an interface for the application220 to access hardware or software components, or control a system taskrelating to the application 220.

According to another aspect, the communication module 261, the socialnetworking module 263, the commerce service module 265, the LBS module267, the interaction module 269, the sensor module 271, the graphicmodule 273 or the text input module 275 may be included in theapplication 220. For example, the communication module 261, the socialnetworking module 263, the commerce service module 265, the LBS module267, the interaction module 269, the sensor module 271, the graphicmodule 273 or the text input module 275 may include a driver of asoftware component and/or hardware component or perform an operation ofthe software component and/or hardware component in association with theOS 210.

Like an embedded OS such as Darwin, Linux, Unix, OSX, Windows, bada (oneof mobile OSs provided by Samsung Electronics, a Korean company) orVxWorks, the OS 210 includes various software components and/or driversto control and manage general system tasks including memory management,storage device control and power control, and enables a communicationbetween the various hardware and software components.

The OS 210 according to an exemplary embodiment may include layers of akernel 211, a device 213, a service 215 and a framework 217.

The kernel 211 may include a real-time OS or a Linux kernel based on thehardware of the apparatus 100.

The device 213 may include platform functions of the apparatus 100provided by a device OS, a graphic and multimedia function andcommunication components. For example, the platform functions mayinclude telephony, security, graphics, or events and window management.

The service 215 may include service-oriented functions which areprovided by application engines and server-assisted components. By theservice 215 which includes contact or messaging engines, the applicationengines may be provided. For example, the server-assisted functions maybe provided by web service components which are connected to servicecomponents of the bada server. As above, the applications may managedata stored in remote servers, including geographical information oruser presence information through the server-assisted functions. Theserver-assisted functions may be accessed by an Application ProgrammingInterface (API) of the framework 217.

The framework 217 may include an open API framework of bada. Theframework 217 may include an application framework as well as interfacesand classes accessing functions of lower layers. The applicationframework may provide application life cycle management, event handlingor an application control function. The interfaces may be provided bythe open API framework. The open API framework may include basicinterfaces which are necessary for data handling, utilities, basicfunctions and application status or application generating a graphicuser interface. The API framework may include not only interfacesenabling access to services provided by lower layers, but also userinterface, or multimedia, communication, internationalization, location,security, commerce or web browsing interfaces.

The communication module 261 enables a communication with other devicesthrough at least one external port 134, and may include various softwarecomponents to process data received by the RF circuit 131 and/or theexternal port 134. The external port 134 such as a universal serial bus(USB) or FireWire may be directly connected to other devices orindirectly connected thereto through a network (such as the Internet orwireless LAN).

The social networking module 263 enables a communication with otherdevices or a network server through the at least one external port 134,and may include various software components to process data received bythe RF circuit 131 and/or the external port 134. The social networkingmodule 263 may share user presence information and the like with otherapplication users or manage user profiles in association with thecommunication module 261. The social networking module 263 may providean interface for the application 220 to share user presence informationwith other application users or manage user profiles. Also, the socialnetworking module 263 or an interface of the social networking module263 may include a mechanism through which application users gather anduse a social networking service on the Internet.

The commerce service module 265 enables a communication with otherdevices or a network server through at least one external port 134, andmay include various software components to process data received fromthe RF circuit 131 and/or the external port 134. The commerce servicemodule 265 may be in association with the communication module 261. Thecommerce service module 265 may operate for a user to sell or purchasegoods (e.g., game items or applications) through a communicationnetwork, or provide an interface which supports such operation to theapplication 220.

The LBS module 267 enables a communication with other devices or anetwork server through at least one external port 134, and may includevarious software components to process data received from the RF circuit131 and/or the external port 134. The LBS module 267 may be inassociation with the communication module 261. The LBS module 267 maytransmit or receive geographical information (e.g., major landmarks,stores, map data or geographical coding services) through acommunication network or process geographical information to be providedto a user or a network server. The LBS module 267 may provide theapplication 220 with an interface including functions using geographicalinformation.

The interaction module 269 may provide a user with a visual, auditory ortactile feedback as a response to a user's motion or touch (or touchgesture), a response to a detect of a user's shape (face or body) or aresponse to a preset event.

For example, upon receiving a touch from the touch screen 121, theinteraction module 269 may include a software component which provides auser with various vibrations patterns as a haptic function to feedback atactile response depending on contact by touch, release of contact, sizeof a contact point, speed, acceleration, direction, change of size orchange of direction through the another I/O controller 123 and/or avibration device (not shown) included in the another I/O device 123. Theinteraction module 269 may provide an effect as if the screen isshaking, together with the graphic module 273 or the display controller111 to increase the vibration. Upon receiving a new message from theinstant messaging module 229 as a preset event, the interaction module269 may provide a vibration or a visual feedback, together with theanother I/O controller 113, a vibration device (not shown), the graphicmodule 273 or the display controller 111.

If the interaction module 269, together with the sensor controller 112,the optical sensor 122 a included in the sensor 122 and/or the sensormodule 271, recognizes a user's shape and determines that the recognizeduser is a user registered with the apparatus 100, it may provide afeedback including a preset sound/voice or preset visual stimulus inassociation with the audio circuit 132, the graphic module 273 or thedisplay controller 111. The interaction module 269 may provide aninterface to enable the application 220 to use the feedback.

The sensor module 271 may process data acquired from the optical sensor122 a, the proximity sensor 122 b, the accelerometer 122 c, the GPSsensor 122 d, the magnetic sensor 122 e, the tilt sensor 122 f, theambient sensor 122 g or the weather sensor 122 h or provide an interfaceto enable the application 220 to use the foregoing data.

For example, the sensor module 271 may acquire location information ofthe apparatus 100 by using data received through the GPS sensor 122 d,and provide various applications with the location information. Thesensor module 271 may provide the telephone module 223 with the locationinformation acquired through the GPS sensor 122 d for a location-basedcall, or provide the camera module 233 and/or blogging module 231 withthe information as metadata such as photo/video. The sensor module 271may provide the map module 243 or an application providing alocation-based service such as navigation and/or the LBS module 267 withthe location information acquired through the GPS sensor 122 d.

The sensor module 271 may provide the weather module 247 with dataacquired from the ambient sensor 122 g or the weather sensor 122 h. Thesensor module 271 may provide the graphic module 273 or the displaycontroller 111 with data acquired from the optical sensor 122 a tochange a brightness of a graphic or adjust a brightness of a backlightof the screen.

The graphic module 273 includes various known software components torender and display a graphic on the touch screen 121, including acomponent to change a brightness of the displayed graphic. “Graphic”used herein means any voluntary object which is displayed, including atext, a web page, an icon such as a user-interface object including asoft key, a digital image, a video and animation.

The text input module 275 may be a component of the graphic module 273.The text input module 275 may provide a soft keyboard to variousapplications (e.g., a contact address module 221, an e-mail clientmodule 227, an instant messaging module 229, the blogging module 231,the browser module 241 or other voluntary applications which need a textinput) to input a text, or an interface which activates an input moduleof a physical keyboard (e.g. Qwerty keyboard).

The application 220 may include the following module (or an instructionset) or a subset or superset thereof: the contact address module 221(also referred to as address book or contact point); the telephonemodule 223, the video conference module 225, the e-mail client module227, the instant messaging (IM) module 229, the blogging module 231, thecamera module 233 for still and/or video images, an image managementmodule 235, a video player module, a music player module, or avideo/music player module 237 integrating the video player module andthe music player module, a note module 239, the browsing module 241, amap module 243, a calendar module 245, the weather module 247, a stockmodule 249, a calculator module 251, an alarm clock module 253, adictionary module 255, a search module 257 or a news module.

The memory 102 may include a word processing module, a JAVA module, anencoding module, a digital authority management module, a voicerecognition module or a voice replication module as the application 220.

The contact address module 221 may be used to manage an address book orcontact address together with the touch screen 121, the displaycontroller 111, the interaction module 269, the graphic module 273and/or the text input module 275. For example, the contact addressmodule 221 may add names on the address book, delete names from theaddress book, connect telephone number, e-mail address, physical addressor other information with names, connect name and image, classify orsort names, initiate communication by the telephone module 223, thevideo conference module 225, the e-mail client module 227 or the IMmodule 227 or provide telephone number or e-mail address to enable theinitiation of communication.

The telephone module 223 may operate together with the RF circuit 131,the audio circuit 132, the touch screen 121, the display controller 111,the interaction module 269, the graphic module 273 and/or the text inputmodule 275. For example, the telephone module 223 may input characterscorresponding to telephone number, access at least one of telephonenumbers of the contact address module 221, revise the input telephonenumber, dial each telephone number, perform dialog or release connectionor hang up if the dialog is over. As described above, wirelesscommunication may employ any of a plurality of communication standards,protocols and technologies.

The video conference module 225 may initiate, perform and end a videoconference between a user and at least one conference attendee togetherwith the RF circuit 131, the audio circuit 132, the touch screen 121,the display controller 111, the optical sensor 122 a, the sensorcontroller 112, the interaction module 269, the graphic module 273, thetext input module 275, the contact address module 221 and/or thetelephone module 223.

The e-mail client module 227 may generate, transmit, receive and managee-mail together with the RF circuit 131, the touch screen 121, thedisplay controller 111, the interaction module 269, the graphic module273 and/or the text input module 275. The email client module 227 maygenerate, transmit and receive e-mail including still or video imagesacquired through the image management module 235 and/or the cameramodule 233.

The IM module 229 may operate together with the RF circuit 131, thetouch screen 121, the display controller 111, the interaction module269, the graphic module 273 and/or the text input module 275. Forexample, the IM module 229 may input characters corresponding to aninstant message, revise the input character, transmit and receive eachinstant message. The transmitted and/or received instant message mayinclude a graphic, a photo, an audio file, a video file and/or otherattachment supported by an MMS and/or Enhanced Messaging Service (EMS).“Instant messaging” used herein may refer to both a telephone-basedmessage such as a message transmitted through SMS or MMS and anInternet-based message such as a message transmitted through XMPP,SIMPLE or IMPS.

The blogging module 231 may transmit to or receive from a blog (e.g. auser's blog) a text, a still image, a video, and/or other graphicstogether with the RF circuit 131, the touch screen 121, the displaycontroller 111, the interaction module 269, the graphic module 273, thetext input module 275, the image management module 235, the browsingmodule 241 and/or the social networking module 263.

The camera module 233 may operate together with the touch screen 121,the display controller 111, the optical sensor 122 a, the sensorcontroller 112, the interaction module 269, the graphic module 273and/or the image management module 235. For example, the camera module233 may capture a video including a still image or a video stream tostore them in the memory 102, modify the property of the still image orthe video or delete such still image or video from the memory 102.

The image management module 235 may operate together with the touchscreen 121, the display controller 111, the interaction module 269, thegraphic module 273, the text input module 275 and/or the camera module233. For example, the image management module 235 may arrange, modify,manipulate, label or delete a still image and/or video image or displayand store such still image and/or video image as a digital slide show oran album.

The video/music player module 237 may include a video player module. Thevideo player module may display a video on the touch screen 121 or anexternal display connected through the external port 134, or play suchvideo, together with the touch screen 121, the display controller 111,the interaction module 269, the graphic module 273, the RF circuit 131and/or the audio circuit 132.

The video/music player module 237 may include a music player module. Themusic player module may play music stored and recorded in at least onefile format including MP3, wma and AAC file and other sound files,together with the touch screen 121, the display controller 111, theinteraction module 269, the graphic module 273, the audio circuit 132,the RF circuit 131 and/or the browsing module 241.

The note module 239 may generate and manage a note or a to-do list,together with the touch screen 121, the display controller 111, theinteraction module 269, the graphic module 273 and/or the text inputmodule 275.

The browsing module 241 may perform the Internet browsing includingsearching, linking, receiving and displaying a web page or a part of theweb page and an attachment linked to the web page and other files,together with the RF circuit 131, the touch screen 121, the displaycontroller 111, the interaction module 269, the graphic module 273and/or the text input module 275.

The map module 243 may receive, display, modify or store data on, e.g.,driving direction, stores in a particular location or adjacent storesand relevant sites, location-based data and other map-related data andmaps, together with the RF circuit 131, the touch screen 121, thedisplay controller 111, the interaction module 269, the graphic module273, the text input module 275, the sensor module 271, the LBS module267 and/or the browsing module 241.

The calendar module 245 may generate, display and store a calendar andrelevant data (e.g., calendar entry, and a to-do list), together withthe RF circuit 131, the touch screen 121, the display controller 111,the interaction module 269, the graphic module 273 and/or the text inputmodule 275.

The weather module 247, the stock module 249, the calculator module 251,the alarm clock module 253 and/or the dictionary module 255 may operatetogether with the RF circuit 131, the touch screen 121, the displaycontroller 111, the interaction module 269, the graphic module 273, thetext input module 275, the communication module 261, the sensor module271 and/or the browsing module 241. The foregoing modules may beapplications which provide weather information, stock information, orcalculator, alarm clock or dictionary function.

The search module 257 may search a text, music, sound, image, videoand/or other files stored in the memory 102 and matching at least onesearch condition such as at least one search word designated by a user,together with the touch screen 121, the display controller 111, theinteraction module 269, the graphic module 273 and/or the text inputmodule 275.

The news module 259 may operate together with the touch screen 121, thedisplay controller 111, the interaction module 269, the graphic module273, the RF circuit 131, the communication module 261, the socialnetworking module 263 and/or the text input module 275. For example, thenews module 259 may receive a web address designated by a user, anetwork address, an html, xml, RSS file including news channel/articlesor a text about a blog or images or Digital Rights Management (DRM)files and other data in the network or of an external device, ordownload such data from the network or the external device to the memory102 and provide a user with such data.

The foregoing modules and applications may correspond to an instructionset to perform at least one of the functions described above. Suchmodules (i.e., an instruction set) do not need to be realized as anindividual software program, procedure or module, and various subsets ofsuch modules may be integrated or rearranged according to variousexemplary embodiments. For example, the video/music player module 237may be a single module or may be classified into a video player moduleand a music player module. According to some exemplary embodiments, thememory 102 may store therein the foregoing modules and the subset of adata configuration. The memory 102 may further store modules and dataconfiguration which are not described above.

FIG. 4 illustrates an example of a screen configuration of the apparatus100 which includes the touch screen 121 according to an exemplaryembodiment.

According to an aspect, an area of the screen 400 may include a statusarea 410, a main area 430 and a command area 450.

The status area 410 may be provided in an upper part of the touch screen121 and provide information relating the status of the apparatus 100.For example, the status information may include connection informationand system/event information. The connection information may include anicon (or graphic) relating to a signal intensity 411, Wi-Fi connection,Bluetooth connection and call connection. The system/event informationmay include an icon (or graphic) relating to time 412, a residual amountlevel of a battery 413, applications on execution (execution of music orradio), reception of message, profile and alarm setting. Such icons mayhave priority and may be sequentially provided in a left or right sideon the status area 410 according to the priority. According to anaspect, an icon which has a lower priority may be hidden while an iconwhich has a higher priority may be displayed always.

On the main area 430, at least one content which accounts for most ofthe touch screen 121 and provided by the apparatus 100 may be displayed.In an upper part of the main area 430, information relating to at leastone content or a UI relating to at least one content may be provided.For example, the content-related information may include a title of acontent, a command name which is executed in a previous screen, a nameor location of a category which includes a currently-displayed content.The content-related UI may include a tab or folder to move to anothercontent at the same level as the content. According to an aspect, if atleast one content is scrolled on the main area 430, the content-relatedinformation or content-related UI provided in an upper side of the mainarea 430 may hold its location on the main area 430 regardless of ascroll gesture.

The command area 450 may be provided in a lower part of the touch screen121, and provide, e.g., a UI such as at least one of soft keys 451 and453 and an option menu 452. According to an aspect, the command area 450may be used as a part of the main area 430 usually, and provide the softkeys 451 and 453 or the option menu 452 depending on circumstances (e.g.when a user contacts, moves or releases such contact). The soft keys 451and 453 may be provided to perform useful functions relating to anapplication on execution. For example, the soft keys 451 and 453 mayinclude a search function, a function returning to a previous screen, afunction canceling an operation being executed and a function adding anew category. The soft keys 451 and 453 may be provided in a left sideor right side of the command area 450 and include at least one key inproportion to the number of available functions. The soft keys 451 and453 may include various graphics, e.g. icons and texts which areintuitive and easy to understand. The option menu 452 may provide anoption with respect to a content displayed on the main area 450 or to anapplication being executed. For example, if a user selects the optionmenu 452, the option menu 452 may provide a soft keyboard having atleast one symbol displayed on the main area 430 or at least oneavailable function or detailed information of contents on the main area430.

The apparatus 100 may include at least one physical UI together with thevirtual UI. According to an aspect, the apparatus 100 may include apower/lock button, a home button, a volume up button and a volume downbutton. The power/lock button may lock or unlock the apparatus or turnon or off the apparatus 100 when pressed long. The home button may benavigated by a voluntary application of an application set executable inthe apparatus 100 (e.g., main page application). The volume up buttonand the volume down button may increase and decrease volume,respectively. According to another exemplary embodiment, the apparatus100 may further include a send button, a camera button and an endbutton. The send button may display a telephone log or connect thelatest received telephone call when pressed long. The camera button mayphotograph by executing a camera application or using the optical sensor122 a of the apparatus 100. The end button may end a currently executedapplication and return to the main page, or end a call connection when auser is on the phone. A set of functions corresponding to the foregoingbutton may be performed by using the same physical button, or functionscorresponding to a single button may be distributed and performed bydifferent physical buttons. The function of the physical button may berealized as a virtual button on the touch screen 121. According toanother exemplary embodiment, the apparatus 100 may receive a verbalinput through the audio circuit 132 as a physical UI to enable ordisable some functions.

Hereinafter, exemplary embodiments of a user interface and its relatedprocess to be implemented on the apparatus 100 will be described.

FIG. 5 illustrates a user interface of an apparatus 100 according to anexemplary embodiment.

The user interface of FIG. 5 may be included in the main area 430 ofFIG. 4. FIG. 5 may include a first area 510 and a second area 530. Thefirst area 510 may provide information related to at least one ofcontents, or a user interface related to at least one of contents. Forexample, if a plurality of graphics 511 to 513 are provided in the firstarea 510 and a user selects one among the plurality of graphics 511 to513, a set of contents corresponding to the selected graphic may bedisplayed on the second area 530. At this time, the graphic may be a tabmenu.

When the set of contents corresponding to one graphic among theplurality of graphics 511 to 513 is displayed on the second area 530,the one graphic may be provided with a visible feedback. For example,the whole or a part of the graphic may be changed in color, thecircumference of the graphic may be highlighted, or the position of thegraphic may be moved.

FIGS. 6A, 6B, and 6C illustrate an example of an operation of a userinterface according to an exemplary embodiment.

According to an exemplary embodiment, a reference numeral 610 of FIG. 6Arepresents a plurality of items 612 as a set of contents correspondingto a graphic 611. Here, the plurality items 612 may be provided byexecuting the contact address module 221, the telephone module 223, etc.

According to another exemplary embodiment, a reference numeral 630 ofFIG. 6B represents a web page 632 as a set of contents corresponding toa graphic 631. Here, the web page 632 may be provided by executing thebrowsing module 241, etc.

According to still another exemplary embodiment, a reference numeral 650of FIG. 6C represents a plurality of thumbnails 652 as a set of contentscorresponding to a graphic 651. For example, the plurality of thumbnails652 may be providing by executing the camera module 233, the imagemanagement module 235, or etc. The plurality of items 612, the web page632 or the thumbnails 652 as described above may be moved in a directioncorresponding to a predetermined direction (e.g., a up or downdirection) in which a user's gesture 613, 633, 653 moves.

FIGS. 7A, 7B, 7C, and 7D illustrate a process of providing a hiddengraphic according to an exemplary embodiment.

Reference numerals 710, 730 and 750 of FIGS. 7A, 7B, and 7C illustrateuser interface screens for displaying at least one graphic and a hiddengraphic on the first area 510 according to an exemplary embodiment. Forexample, the user interface for displaying the hidden graphic may be thewhole or a part of the first area 510. The apparatus 100 can detect auser's gesture for selecting the user interface, and display the wholeor a part of the hidden graphic in response to the user's gesture.

The at least one graphic and the hidden graphic may follow apredetermined order. A reference numeral 770 of FIG. 7D shows an orderin which the at least one graphic and the hidden graphic are positioned.For example, the order of the at least one graphic and the hiddengraphic may be achieved in the form of a stack, a queue, a linked list,etc., and stored in the memory 102 of the apparatus 100.

Each of the first areas in the screens 710, 730 and 750 of FIGS. 7A, 7B,and 7C may include an identifier for showing a direction where thehidden graphic is positioned.

According to an exemplary embodiment, an identifier 714 showing that thehidden graphics 704, 705, 706, and 707 will be displayed from the backof the at least one graphic 701, 702, and 703 may be provided at oneside of the first area in the screen 710 of FIG. 7A. According toanother exemplary embodiment, identifiers 734 and 735 showing that thehidden graphics 701 and 702, 706 and 707, respectively, will bedisplayed from at least one of the front or the back of the at least onegraphic 703, 704, and 705 may be provided at one side of the first areain the screen 730 of FIG. 7B. According to still another exemplaryembodiment, an identifier 754 showing that the hidden graphics 701 to704 will be displayed from the front of the at least one graphic 705 to707 may be provided at one side of the first area in the screen 750 ofFIG. 7C. The identifiers 714, 734, 735 and 754 may have various shapessuch as a triangle, a star, a heart, a finger, an arrow, etc., but notlimited thereto. Also, if a user selects the identifier, the identifiersmay be provided with various visible feedbacks. For example, theidentifiers may be changed in shape or color, or be highlighted.

The first area in the screens 710, 730 and 750 of FIGS. 7A, 7B, and 7Cmay include a user interface for displaying the hidden graphics. Theapparatus 100 detects a user's contact position and a contact releasedposition on the user interface, and determines a direction of thegesture on the basis of the contact position and the contact releasedposition. Further, the apparatus 100 can display the hidden graphiccorresponding to the direction of the gesture in accordance with thedetermination.

According to an aspect, if a user contacts a part of the first area(reference numeral 711), moves the contact frontward keeping the contact(reference numeral 712), and releases the contact (reference numeral713) in the screen 710 of FIG. 7A, the hidden graphics 704 to 707 may bedisplayed from the back. According to another aspect, if a user contactsparts of the first area (reference numerals 731, 733), moves thecontacts backward or frontward keeping the contacts (reference numeral732), and releases the contacts (reference numerals 733, 731) in thescreen 730 of FIG. 7B, the hidden graphics 701 and 702, 706 and 707 maybe displayed from the front or the back, respectively. According tostill another aspect, if a user contacts a part of the first area(reference numeral 751), moves the contact backward keeping the contact(reference numeral 752), and releases the contact (reference numeral753), in the screen 750 of FIG. 7C, the hidden graphics 701 to 704 maybe displayed from the front. The user's gesture for displaying thehidden graphic from the front or the back may include flick, touch andmove, swipe, drag and drop, etc., but not limited thereto.

FIGS. 8A and 8B illustrate a process of providing at least one ofgraphics and a hidden graphic according to an exemplary embodiment.

In the screen 810 of FIG. 8A, the apparatus 100 can detect a user'sgesture 815 for selecting a part of a first area 820. For example, auser's gesture may include touch and hold for selecting a part of thefirst area 820.

In the screen 850 of FIG. 8B, the apparatus 100 may extend the firstarea 820 to a part 860 of a second area 840 in response to a user'sgesture 815, and display a plurality of graphics including at least onegraphic 821, 822, and 823 and hidden graphics 824, 825, and 826 on theextended first area 870. In this case, the whole or a part of the hiddengraphics 824 to 826 may be displayed on an area 860 converted from thesecond area to the first area. At this time, the hidden graphics 824 to826 may be displayed from the bottom of the at least one graphic 821 to823.

When the apparatus 100 detects the user's gesture 815 for selecting apart of the first area 820, a set of contents displayed within thesecond area 840 may be inactivated. For example, The apparatus 100 maynot provide an operation or a visible feedback related to the at leastone content in the state that a user selects at least one among the setsof contents in the second area 840. Also, at this time, the sets ofcontents in the second area 840 may move downward, or some sets ofcontents may be covered with the extended first area 860. Further, thevisible feedback provided to at least one graphic within the first area820 may be removed. For example, if the visible feedback changes thecolor of the at least one graphic from first color to second color, thecolor of the graphic may be returned to the first color.

FIGS. 9A and 9B illustrate a process of moving at least one of theplurality of graphics according to an exemplary embodiment.

In the screen 910 of FIG. 9A, the apparatus 100 selects at least onegraphic 924 among a plurality of graphics 921, 922, 923, 924, 925, and926 within an extended first area 920 where the plurality of graphics921 to 926 is displayed, and detects a user's additional gesture 915 formoving the selected graphic 924. In response to the user's additionalgesture 915, the apparatus 100 may move at least one graphic 923 amongthe plurality of graphics 921 to 926 to an area of the extended firstarea 920. For example, the apparatus 100 may move a first graphic 924among the plurality of graphics 921 to 926 to an area for a secondgraphic 923 among the plurality of graphics 921 to 926. At this time,the second graphic 923 may be one of the displayed graphics on thescreen 810 of FIG. 8A, and the first graphic 924 may be one of thehidden graphics in the screen 810 of FIG. 8A.

In the screen 950 of FIG. 9B, if the at least one graphic 924 among theplurality of graphics 921 to 926 is moved to an area of the first area920 in response to the user's additional gesture 915, the apparatus 100may move at least one 923 among the graphics other than the at least onegraphic 924 to an area from which the at least one graphic 924 is movedout. For example, if the first graphic 924 among the plurality ofgraphics 921 to 926 is moved to an area of the first area 920 and doesnot move for a predetermined period of time, the apparatus 100 may movethe second graphic 923 to an area from which the first graphic 924 ismoved out. At this time, the case where the first graphic 924 is notmoved any longer may include that a user moves the first graphic 924while keeping the contact and keeps or releases the contact on oneposition for a certain period of time.

FIGS. 10A and 10B illustrate a process of moving at least one of theplurality of graphics according to another exemplary embodiment.

In the screen 1010 of FIG. 10A, the apparatus 100 may detect a user'sadditional gesture 1015 for selecting at least one graphic 1024 amongthe plurality of graphics 1021, 1022, 1023, 1024, 1025, and 1026 withinthe extended first area 1020 and moving the selected graphic 1024.

In the screen 1050 of FIG. 10B, the apparatus 100 may move at least onegraphic 1024 among the plurality of graphics to an area of the firstarea 1020 in response to a user's additional gesture 1015, and move agraphic 1023 adjacent to the at lest one graphic 1024 to an area fromwhich the at least one graphic 1024 is moved out. Again, anotheradjacent graphic 1022 is pushed in and moved to an area from which theadjacent graphic 1023 is moved out. For example, when the first graphic1024 among the plurality of graphic 1021 to 1026 is moved to an area ofthe first area 1020, the apparatus 100 moves an adjacent third graphic1023 to an area from which the first graphic 1024 is moved out, andmoves an adjacent second graphic 1022 again to an area from which thethird graphic 1023 is moved out.

FIGS. 11A and 11B illustrate a processing of providing a first group ofgraphics among the plurality of graphics according to an exemplaryembodiment.

In a screen 1110 of FIG. 11A, the apparatus 100 can sense a user'sgesture 1115 for selecting a part of a second area 1140 in the statethat a plurality of graphics 1121, 1122, 1123, 1124, 1125, and 1126 isprovided in an extended first area 1120. At this time, the plurality ofgraphics may be divided into a first group of graphics 1111 and a secondgroup of graphics 1112 in accordance with positions within the extendedfirst area 1120. Here, the first group of graphics 1111 may bepositioned in a higher rank than the second group of graphics 1112.Meanwhile, for example, the user's gesture for selecting a part of thesecond area 1140 may include a tap, a contact, or etc. for selecting thesecond area 1120.

In the screen 1150 of FIG. 11B, the apparatus 100 downsizes an extendedfirst area 1120 to an original area 1160 in response to the user'sgesture 1115, and displays the first group of graphics 1111 in thedownsized first area 1160. At this time, the second group of graphics1112 is hidden, and an identifier 1127 for representing that the secondgroup of graphics 1112 can be provided may be placed at one side of thedownsized first area 1160. Meanwhile, the first group of graphics 1111may include a second graphic 1124 moved to an area for the first graphicin accordance with a user's gesture in FIG. 9A, and the second group ofgraphics 1112 may include a first group of graphics 1123 moved to anarea for the second graphic.

In the screens 1110 and 1150 of FIGS. 11A and 11B, when the first area1120 of the apparatus 100 is downsized to the original area 1160, avisible feedback may be given to at least one 1121 among the pluralityof graphics 1121 to 1124 and contents corresponding to one graphic 1121may be activated. For example, if the visible feedback of the graphic1121 is removed when the first area is enlarged to the extended firstarea 1120, the visible feedback may be given again to the graphic 1121,the feedback of which is removed, as the first area is downsized to theoriginal area 1160. Also, if a set of contents in the second arearelated to the graphic 1121 is inactivated as the first area is enlargedto the extended first area 1120, the set of contents related to thegraphic 1121 may be activated again to receive a user's input as thefirst area is downsized to the original area 1160.

FIG. 12 is a flowchart showing a method of providing a user interface ofthe apparatus 100 according to an exemplary embodiment.

At operation 1201, the apparatus 100 may display a user interface fordisplaying at least one graphic and a hidden graphic in the first area.At operation 1202, the apparatus 100 may display a set of contentscorresponding to one of the at least one graphic in the second areadistinguishable from the first area. Also, the apparatus 100 may displayan identifier for showing a direction, where the hidden graphic isdisposed, at one side of the first area.

In the case that the apparatus 100 detects a user's gesture forselecting the user interface, the apparatus 100 may detect a user'scontact position and a contact released position on the user interface.Further, the apparatus 100 may determines a direction of the gesture onthe basis of the contact position and the contact released position, andthus display the hidden graphic corresponding to the direction of thegesture.

At operation 1203, the apparatus 100 may detect a user's gesture forselecting a part of the first area. At operation 1204, the apparatus 100enlarges the first area up to a part of the second area in response to auser's gesture, and display at least one graphic and a plurality ofgraphics including a hidden graphic in the enlarged first area. At thistime, the apparatus 100 may display at least a part of the graphichidden in an area converted from the second area to the first area.Also, the apparatus 100 may remove the visible feedback given to onegraphic of the at least one graphic. Also, the apparatus 100 mayinactivate at least one set of contents displayed in the second area.

At operation 1205, the apparatus 100 may detect a user's additionalgesture for moving at least one among the plurality of graphics. Atoperation 1206, the apparatus 100 may move at least one among theplurality of graphics to a part of the enlarged first area in responseto the user's additional gesture, and move at least one among thegraphics other than the at least one moved graphic to an area from whichthe at least one graphic is moved out. For example, the apparatus 100may move a first graphic among the plurality of graphics to an area fora second graphic among the plurality of graphics. Further, if the firstgraphic is not moved any more for a predetermined period of time, theapparatus 100 moves the second graphic to an area from which the firstgraphic is moved out.

The apparatus 100 divides the plurality of graphics into a first groupof graphics and a second group of graphics in accordance with respectivepositions of the plurality of graphics. If the apparatus 100 detects auser's gesture for selecting a part of the second area at operation1207, the apparatus 100 may downsize the enlarged first area into anoriginal area and display the first group of graphics on the downsizedfirst area at operation 1208.

As described above, disclosed are a method and an apparatus, in whichfunctions corresponding to respective areas where a user's gesture isreceived are performed when the user's gesture is received in differentareas through a user interface on a screen, so that a user's input canbe more effectively acquired.

The foregoing exemplary embodiments may be realized as a program commandto be executed through various computer means and recorded in a mediumread by a computer. The medium read by the computer may solely orcollectively include a program command, a data file, and a dataconfiguration. The program command which is recorded in the medium isspecifically designed and configured for an exemplary embodiment, butmay be known and accessible by a person skilled in computer software.

The foregoing exemplary embodiments and advantages are merely exemplaryand are not to be construed as limiting. The present teaching can bereadily applied to other types of apparatuses. Also, the description ofexemplary embodiments is intended to be illustrative, and not to limitthe scope of the claims, and many alternatives, modifications, andvariations will be apparent to those skilled in the art.

What is claimed is:
 1. A mobile device comprising: a touch screen; amemory; and a processor configured to: provide a user interface on thetouch screen, wherein the user interface includes a first area fordisplaying menu items comprising a first menu item and a second menuitem and a second area for displaying information that corresponds toone of the menu items on the first area; in response to detecting afirst gesture on the first area of the touch screen, form an extendedfirst area extended from the first area, reduce a size of the secondarea and display a third menu item and a fourth menu item in theextended first area; and in response to detecting a second gesture forselecting one of the third and fourth menu items which is displayed inthe extended first area and dragging the selected menu item to adesignation location of the first area, move the selected menu item fromthe extended first area to the first area and move one of the first andsecond menu items from the designated location of the first area to theextended first area, wherein each of the first menu item, the secondmenu item, the third menu item and the fourth menu item is selectable toallow the mobile device to perform a defined operation.
 2. The mobiledevice according to claim 1, wherein one item moved to a part of theextended first area from which the one item of the third and fourth menuitems is moved out is one item of the first and second menu items. 3.The mobile device according to claim 1, wherein one item moved to a partof the extended first area from which the one item of the third andfourth menu items is moved out is one item of the third and fourth menuitems.
 4. The mobile device according to claim 1, wherein the firstgesture includes touching the first area and the second gesture includestouching the one of the third and fourth menu items and moving thetouched one.
 5. The mobile device according to claim 1, wherein theprocessor is further configured to move the information displayed in thesecond area downwardly according to extending of the first area.
 6. Themobile device according to claim 1, wherein the processor is furtherconfigured to display a detailed menu relating to one among the firstmenu item, the second menu item, the third menu item and the fourth menuitem in response to touching the one among the first menu item, thesecond menu item, the third menu item and the fourth menu item andholding on the touched one for a predetermined time.
 7. The mobiledevice according to claim 1, wherein the processor is further configuredto provide a visual feedback to the one of the first and second menuitems in response to selecting of the one of the first and second menuitems.
 8. The mobile device according to claim 7, wherein the processoris further configured to display contents corresponding to the selectedone of the first and second menu items in the second area of the touchscreen.
 9. The mobile device according to claim 7, wherein the processoris further configured to remove the visual feedback provided to the oneof the first and second menu items in response to touching the one ofthe first and second menu items.
 10. The mobile device according toclaim 1, wherein the processor is further configured to display, in thefirst area, an identifier showing a direction where one of the third andfourth menu items is positioned.
 11. The mobile device according toclaim 10, wherein the processor is further configured to provide avisual feedback to the identifier in response to selecting of theidentifier.
 12. The mobile device according to claim 11, wherein theprocessor is further configured to change a shape of the identifier inresponse to selecting of the identifier.
 13. The mobile device accordingto claim 1, wherein the touch screen includes a status area thatprovides information relating to a status of the device and a main areathat includes the first area and the second area.
 14. The mobile deviceaccording to claim 13, wherein the status area includes time informationand is provided in an upper part of the touch screen.
 15. The mobiledevice according to claim 1, wherein the extended first area includes anarea converted from the second area.
 16. The mobile device according toclaim 1, wherein, in response to detecting the first gesture on thefirst area of the touch screen, the extended first area is extended toan extent that corresponds to the number of the menu items to bedisplayed on the extended first area.